Strategies to implement evidence-informed decision making at the organizational level: a rapid systematic review.

BACKGROUND: Achievement of evidence-informed decision making (EIDM) requires the integration of evidence into all practice decisions by identifying and synthesizing evidence, then developing and executing plans to implement and evaluate changes to practice. This rapid systematic review synthesizes evidence for strategies for the implementation of EIDM across organizations, mapping facilitators and barriers to the COM-B (capability, opportunity, motivation, behaviour) model for behaviour change. The review was conducted to support leadership at organizations delivering public health services (health promotion, communicable disease prevention) to drive change toward evidence-informed public health. METHODS: A systematic search was conducted in multiple databases and by reviewing publications of key authors. Articles that describe interventions to drive EIDM within teams, departments, or organizations were eligible for inclusion. For each included article, quality was assessed, and details of the intervention, setting, outcomes, facilitators and barriers were extracted. A convergent integrated approach was undertaken to analyze both quantitative and qualitative findings. RESULTS: Thirty-seven articles are included. Studies were conducted in primary care, public health, social services, and occupational health settings. Strategies to implement EIDM included the establishment of Knowledge Broker-type roles, building the EIDM capacity of staff, and research or academic partnerships. Facilitators and barriers align with the COM-B model for behaviour change. Facilitators for capability include the development of staff knowledge and skill, establishing specialized roles, and knowledge sharing across the organization, though staff turnover and subsequent knowledge loss was a barrier to capability. For opportunity, facilitators include the development of processes or mechanisms to support new practices, forums for learning and skill development, and protected time, and barriers include competing priorities. Facilitators identified for motivation include supportive organizational culture, expectations for new practices to occur, recognition and positive reinforcement, and strong leadership support. Barriers include negative attitudes toward new practices, and lack of understanding and support from management. CONCLUSION: This review provides a comprehensive analysis of facilitators and barriers for the implementation of EIDM in organizations for public health, mapped to the COM-B model for behaviour change. The existing literature for strategies to support EIDM in public health illustrates several facilitators and barriers linked to realizing EIDM. Knowledge of these factors will help senior leadership develop and implement EIDM strategies tailored to their organization, leading to increased likelihood of implementation success. REVIEW REGISTRATION: PROSPERO CRD42022318994.

What is the specific role of schools and daycares in COVID-19 transmission? A final report from a living rapid review.

Due to rapidly evolving conditions, the question of how to safely operate schools and daycares remained a top priority throughout the COVID-19 pandemic. In response to growing and changing evidence, the National Collaborating Centre for Methods and Tools in Canada maintained a living rapid review on the role of schools and daycares in COVID-19 transmission to guide evidence-informed decision making. This Review presents the final iteration of this living rapid review. 31 sources were searched until Oct 17, 2022. In the final version, eligible studies reported data from Jan 1, 2021 onward on transmission of COVID-19 in school or daycare settings, the effect of infection prevention and control measures on transmission, or the effect of operating schools or daycares on community-level COVID-19 rates. As a rapid review, titles and abstracts were screened by a single reviewer with artificial intelligence integrated into later versions. Full-text screening, data extraction, and critical appraisal were completed by one reviewer and checked by a second reviewer. The Johanna Briggs Institute tools were used for critical appraisal. The certainty of evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation approach, and results were synthesised narratively. Three citizen partners provided input for the final interpretation. This final update includes 73 primary studies. Secondary attack rates were low within school settings when infection prevention and control measures were in place (moderate certainty). Masks might reduce transmission, test-to-stay policies might not increase transmission risk compared with mandatory quarantine, cohorting and hybrid learning might make little to no difference in transmission (low certainty), and the effect of surveillance testing within schools remained inconclusive (very low certainty). Findings indicate that school settings do not substantially contribute to community incidence, hospitalisations, or mortality (low certainty). This living review provides a synthesis of global evidence for the role of schools and daycares during COVID-19, which might be helpful in future pandemics.

Exploring parity in female authorship of pharmacoepidemiology articles: A case study of the Canadian Network for Observational Drug Effect Studies and its citing articles.

PURPOSE: The Canadian Network for Observational Drug Effect Studies (CNODES) studies the benefits and risks of post-market drugs and evaluates its research mobilization efforts for accountability, demonstrating value, and learning. As part of these evaluation efforts, and acknowledging gender disparity in authorship across many academic disciplines, CNODES examined the relationship between gender and authorship in its own journal articles and the literature citing them. METHODS: CNODES articles (published 2012-2017) and all citing articles were identified and extracted using Scopus. Scopus author IDs were used to extract full names and a web service (www.genderapi.com) was used to estimate gender, converting all probabilities <80% to "indeterminate." T-tests and visualizations were used to compare the proportion of females between CNODES and the citing literature. RESULTS: Twenty-eight CNODES articles and 463 citing articles were identified. The mean number of authors per article was 9.5 in CNODES articles and 5.7 in the citing literature. CNODES articles had a female authorship rate of 36%, compared to 29% in the citing literature (7% difference, 95% CI: [1%, 13%]). There were no female authors in 14% of CNODES articles versus 36% of the citing literature. Women were first authors in 25% and corresponding authors in 14% of CNODES articles. CONCLUSIONS: This analysis provides a benchmark and method to monitor progress in female parity in pharmacoepidemiology authorship. Further work is needed to determine and address barriers and facilitators to women's recruitment and advancement in the field of pharmacoepidemiology.

Methods to support evidence-informed decision-making in the midst of COVID-19: creation and evolution of a rapid review service from the National Collaborating Centre for Methods and Tools.

BACKGROUND: The COVID-19 public health crisis has produced an immense and quickly evolving body of evidence. This research speed and volume, along with variability in quality, could overwhelm public health decision-makers striving to make timely decisions based on the best available evidence. In response to this challenge, the National Collaborating Centre for Methods and Tools developed a Rapid Evidence Service, building on internationally accepted rapid review methodologies, to address priority COVID-19 public health questions. RESULTS: Each week, the Rapid Evidence Service team receives requests from public health decision-makers, prioritizes questions received, and frames the prioritized topics into searchable questions. We develop and conduct a comprehensive search strategy and critically appraise all relevant evidence using validated tools. We synthesize the findings into a final report that includes key messages, with a rating of the certainty of the evidence using GRADE, as well as an overview of evidence and remaining knowledge gaps. Rapid reviews are typically completed and disseminated within two weeks. From May 2020 to July 21, 2021, we have answered more than 31 distinct questions and completed 32 updates as new evidence emerged. Reviews receive an average of 213 downloads per week, with some reaching over 7700. To date reviews have been accessed and cited around the world, and a more fulsome evaluation of impact on decision-making is planned. CONCLUSIONS: The development, evolution, and lessons learned from our process, presented here, provides a real-world example of how review-level evidence can be made available - rapidly and rigorously, and in response to decision-makers' needs - during an unprecedented public health crisis.

Building a framework for the evaluation of knowledge translation for the Canadian Network for Observational Drug Effect Studies.

PURPOSE: The Canadian Network for Observational Drug Effect Studies (CNODES), a network of pharmacoepidemiologists and other researchers from seven provincial sites, provides evidence on the benefits and risks of drugs used by Canadians. The Knowledge Translation Team, one of CNODES' four main teams, evaluates the impact of its efforts using an iterative and emergent approach. This article shares key lessons from early evaluation phases, including identifying stakeholders and their evaluation needs, choosing evaluation theories and approaches, and developing evaluation questions, designs, and methods appropriate for the CNODES context. METHODS: Stakeholder analysis was conducted using documentary analysis to determine key contextual factors and research evidence needs of decision maker partners and other stakeholders. Selected theories and frameworks from the evaluation and knowledge translation literature informed decisions about evaluation design and implementation. A developmental approach to evaluation was deemed appropriate due to the innovative, complex, and ever-changing context. RESULTS: A theory of change, logic model, and potential evaluation questions were developed, informed by the stakeholder analysis. Early indicators of program impact (citation metrics, alternative metrics) have been documented; efforts to collect data on additional indicators are ongoing. CONCLUSION: A flexible, iterative, and emergent evaluation approach allows the Knowledge Translation Team to apply lessons learned from completed projects to ongoing research projects, adapt its approaches based on stakeholder needs, document successes, and be accountable to funders/stakeholders. This evaluation approach may be useful for other international pharmacoepidemiology research networks planning and implementing evaluations of similarly complex, multistakeholder initiatives that are subject to constant change.

Measuring the impact of pharmacoepidemiologic research using altmetrics: A case study of a CNODES drug-safety article.

PURPOSE: To provide an overview of altmetrics, including their potential benefits and limitations, how they may be obtained, and their role in assessing pharmacoepidemiologic research impact. METHODS: Our review was informed by compiling relevant literature identified through searching multiple health research databases (PubMed, Embase, and CIHNAHL) and grey literature sources (websites, blogs, and reports). We demonstrate how pharmacoepidemiologists, in particular, may use altmetrics to understand scholarly impact and knowledge translation by providing a case study of a drug-safety study conducted by the Canadian Network of Observational Drug Effect Studies. RESULTS: A common approach to measuring research impact is the use of citation-based metrics, such as an article's citation count or a journal's impact factor. "Alternative" metrics, or altmetrics, are increasingly supported as a complementary measure of research uptake in the age of social media. Altmetrics are nontraditional indicators that capture a diverse set of traceable, online research-related artifacts including peer-reviewed publications and other research outputs (software, datasets, blogs, videos, posters, policy documents, presentations, social media posts, wiki entries, etc). CONCLUSION: Compared with traditional citation-based metrics, altmetrics take a more holistic view of research impact, attempting to capture the activity and engagement of both scholarly and nonscholarly communities. Despite the limited theoretical underpinnings, possible commercial influence, potential for gaming and manipulation, and numerous data quality-related issues, altmetrics are promising as a supplement to more traditional citation-based metrics because they can ingest and process a larger set of data points related to the flow and reach of scholarly communication from an expanded pool of stakeholders. Unlike citation-based metrics, altmetrics are not inherently rooted in the research publication process, which includes peer review; it is unclear to what extent they should be used for research evaluation.

Impact of an organization-wide knowledge translation strategy to support evidence-informed public health decision making.

BACKGROUND: The public health sector is moving toward adopting evidence-informed decision making into practice, but effort is still required to effectively develop capacity and promote contextual factors that advance and sustain it. This paper describes the impact of an organization-wide knowledge translation intervention delivered by knowledge brokers on evidence-informed decision making knowledge, skills and behaviour. METHODS: A case study design was implemented with the intervention and data collection tailored to the unique needs of each case (health department). A knowledge broker provided training workshops and mentored small groups through a seven step process of evidence-informed decision making. The intervention was delivered over 22 months; data related to evidence-informed decision making knowledge, skills and behaviour were collected at baseline and follow-up. Mixed effects regression models were developed to assess the impact of involvement in the intervention on the evidence-informed decision making outcomes. RESULTS: Data from a total of 606 health department staff were collected during baseline: 207 (33%) staff from Case A, 304 (28%) from Case B, and 95 (47%) from Case C. There were a total of 804 participants at follow-up: 258 (42%) from Case A, 391 from Case B (37%), and 155 (50%) from Case C. Statistically significant increases in knowledge and skills were observed overall, and in all three health departments. An increase in evidence-informed decision making behaviour was observed among those intensively involved in the intervention from all cases (statistically significant in Case A). The organizational characteristics of strategic priority, leadership, readiness, and choice of staff emerged as important factors in the change process. CONCLUSIONS: Knowledge brokering is a promising organizational knowledge translation intervention to support evidence-informed decision making. The intervention appeared to have the greatest impact on those who became actively engaged with the knowledge broker in the intervention. Active participation in face-to-face training activities with a knowledge broker, focused specifically on evidence-informed decision making skill development, led to the greatest impact on associated behaviours, knowledge, and skills. Several organizational factors emerged as integral to success of the knowledge translation intervention.